Augmented Reality Design System

ABSTRACT

An augmented reality design system is disclosed. The augmented reality design system allows a user to create a design for an article in real time using a proxy. The system can be configured using a head mounted display for displaying at least one virtual design element over a proxy located in a real-world environment. The system can also be configured using a projector that projects at least one virtual design element onto a proxy located in the real world.

BACKGROUND

The present invention relates generally to a design system and inparticular to an augmented reality design system for use in designingarticles.

Augmented reality systems have been previously proposed. Kobayashi etal. (U.S. patent application publication number 2005/0174361) teaches animage processing method and apparatus. Kobayashi teaches a position andorientation stylus for use in a mixed reality system. The stylus is usedto orient a virtual object with respect to a real model. Kobayashiteaches that a user may use the stylus to touch the real model. Thesystem is then able to determine the position and orientation of thereal object and align the virtual object accordingly.

German patent number 20203367 teaches a system for early visualizationof a vehicle design model in three dimensional form. The devicegenerates a set of data for a vehicle or part of a vehicle. Anotherdevice generates a virtual reality model using the data set to be storedin memory. A control device overlays a real model of a vehicle with thevirtual reality model using augmented reality. A projection device inthe form of a monitor depicts the vehicle model.

The related art lacks provisions for efficiently designing an article inreal time using an augmented reality system.

SUMMARY

In one aspect, the invention provides a method of designing an article,comprising the steps of: viewing a proxy on a display device, the proxyexisting in a real-world environment; contacting the proxy with aninteracting device to create a virtual design for the article; and wherethe virtual design is displayed on the display device so as to appear tobe a part of the proxy.

In another aspect, the invention provides a method of designing anarticle, comprising the steps of: contacting a portion of a proxy withan interacting device to create a virtual design for the article;projecting the virtual design onto the proxy; and where the virtualdesign is projected onto the proxy so as to appear to be a part of theproxy.

In another aspect, the invention provides a method of designing anarticle, comprising the steps of: viewing a proxy on a display device,the proxy existing in a real-world environment and where a portion ofthe proxy has a first color; contacting the portion of the proxy with aninteracting device; and thereby modifying the apparent color of theproxy as seen on the display device so that the color of the portion ischanged from the first color to a second color that is different fromthe first color.

In another aspect, the invention provides a method of designing anarticle, comprising the steps of: selecting a color from a virtual colorpalette associated with a proxy, the proxy existing in a real-worldenvironment and where a portion of the proxy has a first color;contacting the portion of a proxy with an interacting device; projectinga second color onto the portion of the proxy substantially immediatelyafter the interacting device has contacted the portion; and therebychanging the apparent color of the portion.

In another aspect, the invention provides a method of designing anarticle, comprising the steps of: viewing a proxy on a display device,the proxy existing in a real-world environment; contacting the proxywith an interacting device; displaying the virtual line on the displaydevice substantially immediately after contacting the proxy with theinteracting device; and where the virtual line is displayed on thedisplay device so as to appear to be a part of the proxy.

In another aspect, the invention provides a method of designing anarticle, comprising the steps of: contacting a proxy with an interactingdevice; projecting a virtual line onto the proxy substantiallyimmediately after the interacting device has contacted the proxy; andwhere the virtual line is projected onto the proxy so as to appear to bea part of the proxy.

In another aspect, the invention provides an augmented reality designsystem, comprising: an imaging device for receiving images from areal-world environment; an interacting device for interacting with aproxy in the real world environment; a computing device capable ofgenerating virtual images; a display device for viewing at least onevirtual image superimposed onto the proxy; a virtual menu that may bedisplayed on the display device, where the virtual menu is associatedwith a location in the real world environment and where a user caninteract with the virtual menu by placing the interacting device in thelocation; and where the virtual menu can be used to apply a virtualdesign element to the proxy.

In another aspect, the invention provides an augmented reality designsystem, comprising: an imaging device for receiving images from areal-world environment; an interacting device for interacting with aproxy in the real world environment; a computing device capable ofgenerating virtual images; a projecting device for projecting at leastone virtual image onto the proxy; a virtual menu that may be projectedonto a location in the real-world environment and where a user caninteract with the virtual menu by placing the interacting device in thelocation; and where the virtual menu can be used to apply a virtualdesign element to the proxy.

Other systems, methods, features and advantages of the invention willbe, or will become, apparent to one of ordinary skill in the art uponexamination of the following figures and detailed description. It isintended that all such additional systems, methods, features andadvantages be included within this description and this summary, bewithin the scope of the invention, and be protected by the followingclaims.

BRIEF DESCRIPTION OF THE DRAWINGS

The invention can be better understood with reference to the followingdrawings and description. The components in the figures are notnecessarily to scale, emphasis instead being placed upon illustratingthe principles of the invention. Moreover, in the figures, likereference numerals designate corresponding parts throughout thedifferent views.

FIG. 1 is a schematic view of an embodiment of a design system;

FIG. 2 is an isometric view of an embodiment of the design system inuse;

FIG. 3 is an isometric view of an embodiment of a set of design menusfor the design system;

FIG. 4 is an isometric view of an embodiment of a drawing tool beingselected by a user;

FIG. 5 is an isometric view of an embodiment of a design system used toapply a virtual line to a proxy;

FIG. 6 is an isometric view of an embodiment of a design system used toapply a virtual line to a proxy;

FIG. 7 is an isometric view of an embodiment of a design system used toapply a virtual shape to a proxy;

FIG. 8 is an isometric view of an embodiment of a design system used tomodify the apparent color of a proxy;

FIG. 9 is an isometric view of an embodiment of a design system used tomodify the apparent color of a portion of a proxy;

FIG. 10 is an isometric view of an embodiment of a design system used tomodify the apparent color of a portion of a proxy;

FIG. 11 is an isometric view of an embodiment of a design system used toapply a virtual graphic to a proxy;

FIG. 12 is an isometric view of an embodiment of a design system used toapply a virtual graphic to a proxy;

FIG. 13 is an isometric view of an embodiment of a design system used toerase a portion of a virtual stripe;

FIG. 14 is an isometric view of an embodiment of a design system used tomodify a design template for an article;

FIG. 15 is an isometric view of an embodiment of a design system used tomodify a design template for an article;

FIG. 16 is an isometric view of an embodiment of a design system used tomodify a design template for an article;

FIG. 17 is an isometric view of an embodiment of a design system used toapply virtual objects to an article of footwear that is used as a proxy;

FIG. 18 is an isometric view of an embodiment of a step of finalizing adesign for an article;

FIG. 19 is a schematic view of an embodiment of a finalized design beingsubmitted to a proprietor;

FIG. 20 is an embodiment of a process for designing and manufacturing anarticle of footwear;

FIG. 21 is an isometric view of an embodiment of a design system used todesign articles of clothing;

FIG. 22 is an isometric view of an embodiment of a design system used todesign articles of clothing;

FIG. 23 is an isometric view of an embodiment of a design system used todesign articles of clothing;

FIG. 24 is a schematic view of another embodiment of a design system;

FIG. 25 is a schematic view of an embodiment of a design system used todesign an article;

FIG. 26 is a schematic view of an embodiment of a design system used todesign an article;

FIG. 27 is a schematic view of an embodiment of a design system used todesign an article;

FIG. 28 is a schematic view of an embodiment of a design system used todesign an article;

FIG. 29 is a schematic view of an embodiment of a design system used todesign an article;

FIG. 30 is a schematic view of another embodiment of a design system;

FIG. 31 is an isometric view of an embodiment of a design system beingused to design an article; and

FIG. 32 is an isometric view of an embodiment of a design system beingused to design an article.

DETAILED DESCRIPTION

FIG. 1 illustrates an embodiment of augmented reality design system 100,also referred to simply as system 100. The term “augmented realitydesign system” as used throughout this detailed description and in theclaims refers to any system that may be used to design one or morearticles or objects using a combination of real-world views that aremerged with computer generated images. For purposes of clarity, theterms “real” and “virtual” are used throughout this detailed descriptionand in the claims to distinguish between various types of images and/orobjects. For example, a real-world view or real-world image refers toany view or image of a real environment that is occupied by a user. Incontrast, a virtual image or virtual object is any image or object thatis generated by a computing device and which is associated with avirtual environment. Moreover, for purposes of clarity, the term“virtual design element” is used throughout this detailed descriptionand in the claims to refer collectively to any type of virtual object,virtual image or virtual graphic that may be created by, or used with, adesign system. The combination of virtual images or objects with areal-world view or image comprises a view or image that is associated anaugmented reality environment.

System 100 can include one or more components. In one embodiment, system100 may include computing device 102. Computing device 102 may be anytype of computer, including either a desktop or a laptop computer. Inother embodiments, computing device 102 may be any type of device thatincludes a display, a processor, and the ability to transmit and receivedata from one or more external sources. Examples of such devicesinclude, but are not limited to: PDA's, cell phones, as well as othertypes of devices.

System 100 can include provisions for displaying an augmented realityimage for a user. In some embodiments, system 100 can include displaydevice 104. Display device 104 can be any type of display including, butnot limited to: a computer screen or monitor, a head mounted unit, aprojection based display as well as any other kind of display. In thecurrent embodiment, display device 104 may comprise a head mounted unit,or head mounted display (HMD). In particular, in the current embodiment,display device 104 comprises a pair of goggles. As a user looks throughdisplay device 104, one or more virtual images can be displayed over thereal-world view as seen through display device 104. Head mounteddisplays for use in augmented reality systems are known. Examples may befound in U.S. Pat. Nos. 2006/02484791 7,397,481 and 7,110,909, theentirety of both being hereby incorporated by reference.

System 100 can include provisions for capturing optical information. Insome embodiments, system 100 can include imaging device 106. Imagingdevice 106 can be any device capable of sensing optical information. Insome cases, imaging device 106 can be a camera. In some cases, imagingdevice 106 may be a video camera of some kind. Examples of differenttypes of video cameras that could be used include charge coupled device(CCD) cameras, complementary metal-oxide-semiconductor (CMOS) cameras,other types of active pixel sensor cameras as well as any other type ofvideo cameras.

Generally, imaging device 106 can be disposed in any location withrespect to various components of system 100. In some cases, imagingdevice 106 can be stationary. In other cases, imaging device 106 can bemounted to another component of system 100. In an exemplary embodiment,imaging device 106 may be mounted to a portion of display device 104.With this arrangement, imaging device 106 may be configured to receiveoptical information that may also be perceived by a user of system 100as they look around. In other words, using this arrangement, imagingdevice 106 may have a substantially similar view of the real-worldenvironment as a user. In other embodiments, imaging device 106 may bedisposed in another location in which the approximate viewpoint of auser may be captured.

System 100 can include provisions for interacting with an augmentedreality environment. In some cases, system 100 can include interactingdevice 108. Interacting device 108 may take any form. In some cases,interacting device 108 could comprise a stylus. For example, interactingdevice 108 could comprise a stylus similar to the kind used withpersonal digital assistants (PDAs), in which the stylus is asubstantially monolithic component that is used for applying pressure toa display. In the current embodiment, interacting device 108 is asubstantially monolithic component with the approximate shape of a pen.In other cases, however, interacting device 108 could have any othershape, size and composition.

In some embodiments, one or more components of system 100 maycommunicate with computing device 102. In some cases, imaging device 106may communicate with computing device 102. Additionally, in some cases,display device 104 may communicate with computing device 102. Imagingdevice 106 and display device 104 could communicate with computingdevice 102 using any type of wireless and/or wired connections. In somecases, imaging device 106 and display device 104 can communicate withcomputing device 102 using a network of some kind. Examples of suchnetworks include, but are not limited to: personal area networks, localarea networks, wide area networks, client-server networks, peer-to-peernetworks, as well as other types of networks. In some cases, a wirelesslocal or personal area network using the Bluetooth® protocol is used tofacilitate communication between computing device 102 and imaging device106 and/or display device 104. With this arrangement, images gatheredfrom imaging device 106 can be received by computing device 102 andcombined with virtual information. The combined information can then betransmitted back to display device 104 to be displayed for a user. Inparticular, this allows system 100 to augment the view of a user withone or more virtual objects or images.

Although the current embodiment uses a single imaging device, otherembodiments could include two or more imaging devices. Moreover, it willbe understood that in other embodiments any other kinds of sensors couldbe used with system 100. An example of a system using additional kindsof sensors is discussed in detail below.

Although computing device 102 is shown as a stand-alone computer in thecurrent embodiment, in other embodiments, computing device 102 could beintegrated with other components of system 100. For example, in anotherembodiment, computing device 102 could be integrated with display device104. In particular, display device 104 could include provisions forprocessing optical information received by imaging device 106 as well asfor generating virtual images to be displayed in display device 104. Instill other embodiments, computing device 102 could be integrated withany other components of system 100. In another example, computing device102 could be a portable device that may be worn or carried by a user toenhance the portability of system 100. Furthermore, in some embodiments,computing device 102 may not be located near various components ofsystem 100. For example, in another embodiment, imaging device 106 anddisplay device 104 may communicate remotely with computing device 102using a network as discussed above. Such an arrangement may increase theportability of system 100, especially of imaging device 106 and displaydevice 104.

System 100 can include provisions for communicating with proprietor 110.Proprietor 110 may include one or more factories, multiple offices,retailers and various other establishments associated with a business.Generally, the term “proprietor,” as used throughout this detaileddescription and in the claims, may also refer to distributors and/orsuppliers. In other words, the term proprietor may also apply to variousoperations on the manufacturing side, including the operationsresponsible for parts, labor, and/or retail of the article of footwear,as well as other manufacturing side operations. With this arrangement, adesign created using system 100 can be submitted to proprietor 110 forpurposes of manufacturing retail items using the design.

Computing device 102 and proprietor 110 can communicate using network112. Generally, network 112 can be any type of network including any ofthe networks discussed above. In some embodiments, network 112 may be apacket-switched communications system. In an exemplary embodiment,network 112 may be the Internet. Moreover, it should be understood thatin some cases, system 100 may be operated directly by proprietor 110.

FIG. 2 illustrates an embodiment of augmented reality design system 100being operated by user 200. Generally, user 200 can be anyone capable ofoperating system 100. In some cases, user 200 may be a professionaldesigner of some kind. For example, in one embodiment, user 200 may be adesigner that works for proprietor 110. In other cases, however, user200 may be a customer who intends to purchase merchandise that isdesigned using system 100. In still other cases, user 200 could beanyone capable of operating system 100.

System 100 can be used with proxy 210. Proxy 210 may be configured inthe general shape of an article of some kind. Proxy 210 could beassociated with any type of article including, but not limited to:footwear, gloves, shirts, pants, socks, scarves, hats, jackets, as wellas other articles. Other examples of articles include, but are notlimited to: shin guards, knee pads, elbow pads, shoulder pads, as wellas any other type of protective equipment. Additionally, in someembodiments, the article could be another type of article that is notconfigured to be worn, including, but not limited to: balls, bags,purses, backpacks, as well as other articles that may not be worn.

In the current embodiment, proxy 210 may be configured in the shape ofan article of footwear. In one embodiment, proxy 210 may have the shapeof a footwear last that is used for forming a shoe. In anotherembodiment, proxy 210 could have the shape of an article of footwear. Insome cases, proxy 210 could have the shape of a specific type offootwear including, but not limited to: running footwear, cross trainingfootwear, basketball footwear, soccer footwear, football footwear, highheel footwear, boots, slip-on footwear, low top footwear, sandals, aswell as other types of footwear. In still other embodiments, proxy 210could have any other shape.

In the current embodiment, proxy 210 may be blank without any markings.However, in other embodiments, to facilitate designing an article, proxy210 could include various types of markings that indicate theapproximate locations of various footwear features. For example, in oneembodiment, proxy 210 could include a marking indicating the generallocation of the lacing region of an article, including, in some cases,markings indicating laces of some kind. As another example, proxy 210could have markings that distinguish a sole of the footwear from anupper of the footwear. In some cases, providing additional markings mayallow a designer to adapt the design to various different features ofthe footwear. Furthermore, it will be understood that in some casesthese markings could be physically provided on proxy 210 and in othercases such markings could be applied virtually using system 100.

System 100 may be adapted for use in various design environmentsincluding any offices, factories or any other kind of location. Forexample, in the current embodiment, proxy 210 may be disposed onworkbench 220. In other cases, however, proxy 210 could be disposed on astand of some kind.

The operation of system 100 includes receiving a real-world view atimaging device 106. In particular, as a user looks at proxy 210, imagingdevice 106 captures an image of proxy 210 as well as the surroundingenvironment. System 100 may be configured with visual tracking softwarethat is capable of precisely determining the location and orientation ofproxy 210. Various types of visual tracking software are known in theart. This information may then be transmitted to computing device 102.At this point, computing device 102 may combine virtual objects orvirtual images with images of the real-world environment. In particular,computing device 102 may be configured to display virtual objects orvirtual images at display device 104, so that user 200 sees an augmentedimage including both real-world images and virtual images. Moreover, aspreviously discussed, imaging device 106 may be used to track the motionof interacting device 108. With this arrangement, user 200 may be ableto manipulate one or more virtual images using interacting device 108.

For purposes of understanding the embodiments, images seen by a userthrough display device 104 are illustrated schematically in many of theFigures. For example, in the current embodiment, user 200 may see thereal-world environment including proxy 210 through screen 240 of displaydevice 104. In particular, in the current embodiment, screen 240 is atransparent screen through which user 200 may view the real worldenvironment. Furthermore, virtual images may be displayed on screen 240as discussed in detail below.

As previously discussed, system 100 can be utilized for purposes ofdesigning an article of some kind. In the current embodiment, system 100may be used to design various types of footwear. For example, system 100may be used to apply various types of graphics including, but notlimited to: lines, shapes, pictures, images, text, numbers, indicia aswell as any other kind of graphics to a design for an article. System100 can also be used to modify the colors, textures, materials or anyother features of an article that may be incorporated into the design ofan article.

Referring to FIG. 3, system 100 may include provisions for assistinguser 200 in applying a design to proxy 210. In some cases, system 100can provide one or more design menus. A design menu may be a virtualmenu that is displayed on display device 104. Design menus can includetool menus, color menus, graphics menus as well as any other kind ofmenus. Design menus make take the form of boxes, palettes, lists, or anyother configuration.

In the current embodiment, system 100 includes tool palette 302. In somecases, tool palette 302 may be a virtual palette that is displayed ondisplay device 104. Moreover, tool palette 302 may be displayed in amanner so that tool palette 302 appears to be disposed adjacent to proxy210.

In different embodiments, the types of tools available within toolpalette 302 can vary. In this case, tool palette 302 includes selectiontool 304 that can be used for selecting portions of proxy 210 orportions of a virtual image associated with proxy 210. In addition, toolpalette 302 can include drawing tool 306 that may be used to drawvirtual lines on proxy 210. Additionally, tool palette 302 can includeletter tool 308 that may be used to apply letters and words to portionsof proxy 210. It will be understood that these tools are only intendedto be exemplary and in other embodiments any other types of toolstypically associated with graphic editing software could be used.

System 100 can also include graphics menu 320. Graphics menu 320 mayinclude a set of predesigned graphics. For example, in the currentembodiment, graphics menu 320 includes first graphic 322 and secondgraphic 324. For purposes of clarity, only two graphics are shown.However, in other embodiments, any other number of graphics could beincluded.

In some embodiments, system 100 can include provisions for allowing auser to import various designs or graphics from outside sources. In someembodiments, a user may attach various media devices to computing device102 in order to import various graphics or designs to system 100. Insome embodiments, a user may upload pictures, images and/or photos froma digital camera, a scanner, or any other device. Furthermore, in somecases, various types of designs or design elements may be gathered fromother sources including the Internet.

FIGS. 4 through 13 are intended to illustrate the operation of anembodiment of system 100. Referring to FIG. 4, user 200 may useinteracting device 108 to select drawing tool 306. In particular, user200 may move interacting device 108 so that stylus 108 intersects toolpalette 302. In this case, tool palette 302 is a virtual palette thatdoes not correspond to any object in the real-world environment.However, system 100 may track the position of interacting device 108 andmay associate tool palette 302 with a real-world position that isadjacent to proxy 210. Then, as interacting device 108 moves into thereal-world position associated with tool palette 302, system 100 mayrecognize an interaction between tool palette 302 and interacting device108. In particular, in this case, system 100 may recognize that a userhas intended to select drawing tool 306. With this arrangement,interacting device 108 may now function as a drawing device such as abrush, pen or pencil that can create virtual lines or strokes on proxy210.

Referring now to FIG. 5, with interacting device 108 functioning as adrawing tool, user 200 may begin to apply various virtual designelements to proxy 210. In this embodiment, user 200 may drag interactingdevice 108 against the surface of proxy 210 to create virtual line 502.In this case, imaging device 106 receives optical information that istransmitted to computing device 102. Using this optical information,computing device 102 tracks the position of interacting device 108 andis able to detect when interacting device 108 has made contact with thesurface of proxy 210. Since interacting device 108 is currentlyfunctioning as a drawing tool, computing device 102 may generate virtualline 502 that is displayed on screen 240. In particular, virtual line502 is displayed on a portion of screen 240 such that user 200 seesvirtual line 502 as being disposed on top of proxy 210. In other words,system 100 combines virtual line 502 with proxy 210 to give theappearance that a line has been drawn directly onto proxy 210, from theperspective of user 200. Moreover, virtual line 502 is displayedsubstantially immediately after interacting device 108 has contactedproxy 210.

In some embodiments, virtual line 502 may be any type of line. In somecases, virtual line 502 may have a substantially straight, or linear,shape. In other cases, virtual line 502 could have a nonlinear shape.Furthermore, virtual line 502 may be a curved line that corresponds tothe contours of the surface of proxy 210. This may enhance theperception that virtual line 502 is part of proxy 210, from theviewpoint of user 200.

In some embodiments, the properties of any lines created using system100 could be varied. For example, in some cases, the thickness of a linecould be varied using a virtual menu. In other cases, the style of line,including solid lines and dashed lines, could vary. Moreover, in somecases, the properties of a virtual line could be modified beforeapplying a line to proxy or after the line has already been applied. Itwill be understood that any of the known features for modifying theproperties of a line using graphic editing software could be used.

Referring now to FIG. 6, user 200 may continue tracing a line over proxy210 using interacting device 108. In this case, user 200 has rotatedproxy 210 to continue drawing a single line from one side of proxy 210to the other side. System 100 continues to track the position andorientation of proxy 210 and modifies the orientation of virtual line502 accordingly to give the appearance of a line permanently drawn onthe surface of proxy 210.

Referring now to FIG. 7, system 100 can be used to draw any kinds ofshapes including, but not limited to: circles, ellipses, triangles,squares, rectangles, trapezoids, pentagons, hexagons, regular polygons,irregular polygons as well as any other kinds of shapes. In the currentembodiment, user 200 may draw virtual star shape 702 onto the side ofproxy 210 using interacting device 108.

System 100 can include provisions for applying different colors to adesign for an article. In some embodiments, system 100 can be configuredwith one or more color palettes. A color palette may allow a user toselect a color to be applied to any portion of a proxy. Various types ofcolor palettes are known in the art and can include any type of colorpalette found in graphical editing software.

Referring to FIG. 8, system 100 may include color palette 802. In somecases, color palette 802 may comprise a color-wheel type color palette.In other cases, color palette 802 may provide a plurality of boxes withdifferent colors. User 200 may select a color from color palette 802 bypointing interacting device 108 at the desired color. In thisembodiment, user 200 may select color 804 from color palette 802. Thishas the effect of changing the color of proxy 210 to color 804. Inparticular, system 100 may generate virtual coloring image 810 withcolor 804 that is applied over proxy 210. Virtual coloring image 810 hasthe approximate size, shape and orientation of proxy 210 so as to givethe appearance that proxy 210 has been painted with color 804. Moreover,virtual line 502 and virtual star shape 702 are superimposed overvirtual coloring image 810.

It will be understood that when user 200 rotates proxy 210 or when user200 moves so as to change the perspective of proxy 210, system 100continuously adjusts the orientation and position of virtual coloringimage 810, virtual star shape 702 and virtual line 502 to give theappearance that these design elements have been permanently applied tothe three dimensional proxy.

Referring now to FIGS. 9 and 10, virtual colors for proxy 210 can alsobe configured on local portions of proxy 210. In the current embodiment,user 200 may select toe portion 211 of proxy 210 using interactingdevice 108. In some cases, to select toe portion 211, user 200 may setinteracting device 108 to function as a selection tool. In other cases,user 200 may select a coloring tool from a virtual menu and then selectthe desired portion of proxy 210 for coloring.

In some cases, color palette 902 may appear as user 200 selects toeportion 211 using interactive device 108. In some cases, toe portion 211may be highlighted using virtual boundary 910. At this point, as seen inFIG. 10, user 200 may select a color for toe portion 211 using colorpalette 902. This color may then be applied throughout toe portion 211.

Although the current embodiment shows a user modifying the color of toeportion 211, in other cases, a user could modify any other portion ofproxy 210. Other portions that could be colored include, but are notlimited to: a midfoot portion, a heel portion, a lower portion, an upperportion, a medial portion, a lateral portion as well as any otherportion of proxy 210. In embodiments where proxy 210 comprises a soleportion and an upper portion, a user could separately modify the colorof the sole portion and/or the upper portion. In addition, inembodiments where a proxy includes a lacing portion that includes lacesor markings indicating the location of laces, a user could modify thecolor of the lacing portion.

Referring now to FIGS. 11 and 12, user 200 may apply one or more virtualgraphics to proxy 210. In this case, user 200 may select first graphic322 from graphics menu 320 using interacting device 108. User 200 maythen place first graphic 322 on the surface of proxy 210 by contactingproxy 210 with interacting device 108. At this point, system 100 mayautomatically adjust the appearance of first graphic 322 so firstgraphic 322 appears to be physically located on proxy 210. Moreover, asproxy 210 is moved and rotated, system 100 may adjust the orientationand position of first graphic 322 accordingly. Although the currentembodiment illustrates a single graphic being applied to proxy 210, inother embodiments two or more graphics could be applied to proxy 210.

Generally, virtual graphics applied to a proxy could be predesignedgraphics or custom designed graphics. For example, in some cases, a usercould create a custom designed graphic using system 100 and store thegraphic in graphics menu 320. This allows a user to retrieve the graphicat any time for application to a proxy. In other embodiments, system 100could provide a set of predesigned graphics.

Referring to FIG. 13, user 200 may delete portions of a virtual objectusing eraser tool 1302. In this case, user 200 may erase portions ofvirtual line 1304 by touching interacting device 108 to the portion ofproxy 210 associated with virtual line 1304. This has the effect ofdeleting a portion of virtual line 1304.

In some embodiments, system 100 could provide a user with one or morepre-existing designs or template designs. Template designs may includeany design for a proxy that has been created prior to the current designsession. In some cases, template designs could be provided by aproprietor. In other cases, template designs could be created by a userduring a previous design session.

FIGS. 14 through 16 illustrate the use of an embodiment of system 100for working with template designs. Referring to FIG. 14, user 200 mayselect a template design from template menu 1402. In this case, templatemenu 1402 includes first template design 1410 and second template design1412. User 200 has selected first template design 1410 using interactingdevice 108. With first template design 1410 selected, a set of virtualdesign elements are automatically generated and displayed over proxy210. For example, in the current embodiment, first template design 1410includes virtual upper trim 1420, virtual stripe 1422 and virtual upperpanel 1424. This arrangement allows a user to modify an existing design,rather than having to create a design for an article from scratch.

Upon selecting a template design for proxy 210, user 200 may modify thedesign using any of the graphics tools discussed previously or any otherknown graphics tools. For example, referring to FIG. 15, user 200 mayadd virtual border 1502 around virtual upper panel 1424 using a drawingtool. In addition, as seen in FIG. 16, a user may modify the color ofvirtual upper panel 1424 using color palette 1602.

Using this arrangement, a user may make modifications to existingdesigns to produce articles with new and unique design characteristics.A designer could use this feature when designing a successor to acurrent model of footwear. For example, some articles may be redesignedon an approximately annual basis. The configuration discussed here wouldallow a designer to select a template design corresponding to the mostrecent model of footwear from the previous year and start redesigningthe footwear immediately, rather than having to start with a blankdesign.

System 100 may include provisions for applying virtual designs tovarious types of proxies. In some cases, system 100 could be configuredfor use with fully formed articles, rather than models of the articles.For example, in situations where system 100 is used for designing anarticle of footwear, the proxy could be a specific type of shoe ratherthan a footwear last.

FIG. 17 illustrates an embodiment of system 100 that uses an article offootwear for proxy 1710 rather than a footwear last. Referring to FIG.17, proxy 1710 comprises upper 1720 and sole structure 1722. Inaddition, upper 1720 includes first design element 1730 and seconddesign element 1732. These design elements are physical design elementsthat are part of proxy 1710. In some cases, using an article of footwearfor proxy 1710 may help a user to visualize the final manufacturedproduct.

In this embodiment, user 200 may apply virtual line 1740 to proxy 1710using interactive device 108. As user 200 drags interacting device 108across the surface of proxy 1710, virtual line 1740 is displayed onscreen 240 over proxy 1710. This gives the appearance of a line that hasbeen created on proxy 1710. With this arrangement, a user can modify thedesign of an existing article of footwear by applying virtual objects orvirtual images to the article of footwear using system 100.

For purposes of clarity, the current embodiments illustrate designing anarticle with various lines, colors, graphics as well as other kinds ofindicia. However, it should be understood that in other embodiments,additional sorts of components for an article could be designed using anaugmented reality design system. In some cases, design lines producedusing an augmented reality design system could represent functionalfeatures of an article.

In some embodiments, a design system could be used for designing variousphysical and/or functional components including, but not limited to:straps, heel counters, toe caps, outsoles, midsoles, laces, as well asother functional components for an article. For example, in oneembodiment, a user could design an outsole for a sole by drawing atraction pattern on the bottom surface of a proxy. In another example, auser could draw a strap onto a portion of a proxy. As another example, auser could draw one or more inserts that may be utilized with one ormore portions of an article. Examples of straps and inserts that couldbe designed using an augmented reality design system can be found inGerber, U.S. Pat. No. ______ (now U.S. patent application Ser. No.12/o358,234) directed to an Article of Footwear with a CustomizableUpper; the entirety of which is hereby incorporated by reference.

In some embodiments, design lines indicating outsole patterns, straps,heel counters as well as any other functional components may be used bya proprietor to design a finished article. In some cases, a system caninclude provisions for distinguishing between functional design lines(for example, lines indicating a heel counter) and decorative designlines (for example, lines indicating one or more stripes). In somecases, design lines intended to be associated with functional componentscould be stored with additional information so that a proprietor caneasily distinguish between different types of design lines. In othercases, however, each design line may be stored in a substantiallysimilar manner and a proprietor may rely on context or other cues todistinguish functional design lines from design lines used fordecoration.

Referring now to FIG. 18, in some cases, system 100 may prompt a userwhen a design session has concluded. For example, in the currentembodiment, user 200 has finished creating a design for an article usingproxy 1810. In particular, user 200 has applied virtual design elements1812 to proxy 1810 using system 100. At this point, system 100 mayprompt user 200 to determine if the design should be finalized. In somecases, dialogue box 1850 may be displayed for user 200. In this case,user 200 indicates that the he is done designing an article usinginteracting device 108.

The finalized design may be submitted to a proprietor for purposes ofmanufacturing a finalized article of footwear. As seen in FIG. 19, insome cases, the finalized design may be transmitted to computing device1902 of a proprietor through network 112. At this point, the proprietormay manufacture an article of footwear using the finalized design.

FIG. 20 illustrates an embodiment of a process of creating an articlethat has been designed using system 100. In this embodiment, some of thefollowing steps may be performed by any proprietor configured tomanufacture and/or sell articles. Also, some of the steps may beperformed by a customer or any other user of system 100. In addition, itwill be understood that in other embodiments one or more of thefollowing steps may be optional.

During step 2002, a user may design an article using augmented realitydesign system 100. Methods and tools for designing an article in thismanner have been discussed in detail above. Next, during step 2004, thedesign may be received by a proprietor. The proprietor can include anyof the various operations on the manufacturing side, including theoperations responsible for parts, labor, and/or retail of the article offootwear, as well as other manufacturing side operations. Next, duringstep 2006, an article may be manufactured according the design submittedby the user. This step can be accomplished using any known manufacturingtechnology. Examples of one type of manufacturing technology that couldbe used is disclosed in U.S. Ser. No. 11/612,320, filed on Dec. 18,2006, the entirety of which is hereby incorporated by reference.

As previously discussed, an augmented reality design system can be usedfor designing any kind of article. In some embodiments, an augmentedreality design system can include provisions for designing articles ofclothing. In an exemplary embodiment, an augmented reality design systemcan include provisions for designing shirts and pants.

FIGS. 21 through 23 illustrate an embodiment of augmented reality designsystem 100 that is configured for designing various articles ofclothing. In this case, system 100 may be used with proxy 2100. Proxy2100 may have the general form of a full length mannequin. Inparticular, proxy 2100 includes upper portion 2102 that may be used todesign various articles that are worn on the torso and arms includingt-shirts, long sleeve shirts, button-up shirts, sweaters, vests, jacketsas well as any other kinds of articles. Proxy 2100 may also includelower portion 2104 that may be used to design various articles that areworn on the legs including pants, jeans, khakis, shorts, skirts,swimsuits as well as any other kinds of articles. Moreover it will beunderstood that proxy 2100 can be used for designing articles thatextend over both upper portion 2102 and lower portion 2104, including,but not limited to: dresses, suits, swimsuits, uniforms of various kindsas well as any other kinds of articles.

Generally, the various graphic tools for creating designs for articlesof footwear that have been discussed in the previous embodiments canalso be applied to creating designs for any other articles includingshirts and/or pants. Referring to FIG. 22, user 200 may create a designfor a shirt by applying virtual images to upper portion 2102. In thiscase, user 200 may create virtual stripes 2110 using interacting device108. In addition, as seen in FIG. 23, user 200 may create a design for apair of pants by modifying the color of lower portion 2104 of proxy 2100using color palette 2120.

The current embodiments are not intended to be limiting and in otherembodiments, system 100 could be used with any other types of proxiesfor purposes of designing various different types of articles. Asanother example, system 100 can be used with a proxy shaped like a headfor the purposes of designing hats. In still another example, system 100can be used with a proxy having a hand-like shape for purposes ofdesigning gloves. Moreover, the system is not necessarily restricted touse in designing articles that may be worn, as previously discussed. Inanother embodiment, system 100 could be used with a proxy having abag-like shape for purposes of designing various kinds of bagsincluding, but not limited to: purses, backpacks, luggage as well asother kinds of bags.

In the current embodiment, proxy 2100 may be blank without any markings.However, in other embodiments, to facilitate designing an article, proxy2100 could include various types of markings that indicate theapproximate locations of various features for an article of clothing.For example, in one embodiment, proxy 2100 could include markingindicating the boundaries of a short sleeve shirt that may be associatedwith proxy 2100. In another embodiment, proxy 2100 could includemarkings indicating the boundaries of a pair of pants that may beassociated with proxy 2100. In some cases, providing additional markingsmay allow a user to adapt the design to various different features ofthe article of clothing. Furthermore, it will be understood that in somecases these markings could be physically provided on proxy 2100 and inother cases such markings could be applied virtually using system 100.

In addition, in some cases, a user could place an article of clothingdirectly onto proxy 2100. For example, to design a shirt, a user couldplace a shirt onto upper portion 2102 of proxy 2100. Then, using system100, the user could apply various virtual design elements to the shirt.Similarly, a user could place a pair of pants onto lower portion 2104 ofproxy 2100 and apply various virtual design elements to the pants.

An augmented reality design system can include provisions for applyingvirtual images to a proxy without the use of a display device. In somecases, a virtual image may be superimposed directly onto a proxy. In anexemplary embodiment, a virtual image may be projected directly onto aproxy for purposes of designing an article in real time.

FIG. 24 illustrates another embodiment of augmented reality designsystem 2400, also referred to hereafter as system 2400. System 2400 mayinclude substantially similar systems and components to system 100discussed above. For example, system 2400 may include computing device2402. Computing device 2402 may be any type of computer, includingeither a desktop or a laptop computer. In other embodiments, computingdevice 2402 may be any type of device that includes a display, aprocessor, and the ability to transmit and receive data from one or moreexternal sources. Examples of such devices include, but are not limitedto: PDA's, cell phones, as well as other types of devices.

System 2400 can include provisions for superimposing virtual images orvirtual objects directly onto a proxy of some kind. In some embodiments,system 2400 can include projecting device 2404. Projecting device 2404may be any type of projector that is known in the art. Examples ofprojecting devices that may be used in augmented reality systems areknown in the art. In an exemplary embodiment, projecting device 2404 maybe a digital projector.

System 2400 can include provisions for capturing visual information. Insome embodiments, system 2400 can include imaging device 2406. Imaginedevice 2406 can be any device capable of sensing optical information. Insome cases, imaging device 2406 can be a camera. In some cases, imagingdevice 2406 may be a video camera of some kind. Examples of differenttypes of video cameras that could be used include charge coupled device(CCD) cameras, complementary metal-oxide-semiconductor (CMOS) cameras,other types of active pixel sensor cameras as well as any other type ofvideo cameras.

Generally, imaging device 2406 can be disposed in any location withrespect to various components of system 2400. In some cases, imagingdevice 2406 can be stationary. In other cases, imaging device 2406 canbe mounted to another component of system 2400. In an exemplaryembodiment, imaging device 2406 may mounted to a user in some way. Forexample, in one embodiment, imaging device 2406 may be mounted to aheadset of some kind worn by the user. In other cases, however, imagingdevice 2406 may be disposed in a stationary location with respect to auser and/or a proxy.

System 2400 can include provisions for interacting with an augmentedreality environment. In some cases, system 2400 can include interactingdevice 2408. Interacting device 2408 may take any form. In some cases,interacting device 2408 could comprise a stylus. For example,interacting device 2408 could comprise a stylus similar to the kind usedwith personal digital assistants (PDAs), in which the stylus is asubstantially monolithic component that is used for applying pressure toa display. In the current embodiment, interacting device 2408 is asubstantially monolithic component with the approximate shape of a pen.In other cases, however, interacting device 2408 could have any othershape, size and composition.

In some embodiments, one or more components of system 2400 maycommunicate with computing device 2402. In some cases, imaging device2406 may communicate with computing device 2402. Additionally, in somecases, projecting device 2404 may communicate with computing device2402. Imaging device 2406 and projecting device 2404 could communicatewith computing device 2402 using any type of wireless and/or wiredconnections. In some cases, imaging device 2406 and projecting device2404 can communicate with computing device 2402 using a network of somekind. Examples of such networks include, but are not limited to:personal area networks, local area networks, wide area networks,client-server networks, peer-to-peer networks, as well as other types ofnetworks. In some cases, a wireless local or personal area network usingthe Bluetooth® protocol is used to facilitate communication betweencomputing device 2402 and imaging device 2406 and/or projecting device2404. With this arrangement, images gathered from imaging device 2406can be received by computing device 2402 and combined with virtualinformation. The combined information can then be transmitted back toprojecting device 2404 to be projected onto a proxy. In particular, thisallows system 2400 to augment the appearance of a proxy with one or morevirtual objects or images.

Although the current embodiment uses a single imaging device, otherembodiments could include two or more imaging devices. Moreover, it willbe understood that in other embodiments any other kinds of sensors couldbe used with system 2400. An example of a system using additional kindsof sensors is discussed in detail below.

For purposes of clarity, system 2400 is shown with a single projectingdevice in the current embodiment. By rotating a proxy, a singleprojecting device may be used to generate virtual images onto variousdifferent sides of the proxy so as to give the appearance of the virtualimages being part of the proxy. However, in some cases where a user maywalk around a stationary proxy to view different sides, it may benecessary to use more than one projecting device to simultaneously applyvirtual images to multiple sides of the proxy. Therefore, in otherembodiments, system 2400 could include two or more projecting devices.

Although computing device 2402 is shown as a stand-alone computer in thecurrent embodiment, in other embodiments, computing device 2402 could beintegrated with other components of system 2400. For example, in anotherembodiment, computing device 2402 could be integrated with projectingdevice 2404. In particular, projecting device 2404 could includeprovisions for processing optical information received by imaging device2406 as well as for generating virtual images to be projected directlyonto a proxy. In still other embodiments, computing device 2402 could beintegrated with any other components of system 2400. In another example,computing device 2402 could be a portable device that may be worn orcarried by a user to enhance the portability of system 2400.Furthermore, in some embodiments, computing device 2402 may not belocated near various components of system 2400. For example, in anotherembodiment, imaging device 2406 and projecting device 2404 maycommunicate remotely with computing device 2402 using a network asdiscussed above.

System 2400 can include provisions for communicating with proprietor2410. In some cases, computing device 2402 and proprietor 2410 cancommunicate using network 2412. Generally, network 2412 can be any typeof network including any of the networks discussed above.

FIGS. 25 through 29 are intended to illustrate the operation of anembodiment of system 2400. Referring to FIG. 25, system 2400 may be usedwith proxy 2510 for purposes of designing an article. In this case,proxy 2510 has a footwear last-like geometry and may be used fordesigning articles of footwear. In other embodiments, however, system2400 could be used with any other type of proxy for purposes ofdesigning any kind of articles. Examples of other articles that could bedesigned using system 2400 include any of the articles discussedpreviously as well as any other kinds of articles.

In the current embodiment, proxy 2510 is disposed on workbench 2560. Inother cases, however, proxy 2510 could be disposed on a stand of somekind. In addition, imaging device 2406 and projecting device 2404 aremounted to first tripod 2450 and second tripod 2452, respectively. Inother cases, however, imaging device 2406 and/or projecting device 2404could be set up in any other manner.

Referring to FIG. 25, projecting device 2404 may be configured toproject images onto proxy 2510. At this point, since no virtual imagehas been created by user 2500, projecting device 2404 may not projectany images onto proxy 2510. However, as user 2500 contacts proxy 2510with interacting device 2408, system 2400 may be configured to generatevirtual line 2602, as seen in FIG. 26. In particular, as imaging device2406 may be used to track the locations of proxy 2510 as well asinteracting device 2408. As interacting device 2408 contacts proxy 2510,system 2400 automatically generates a mark at the contact point. Thismark is projected by projecting device 2404 directly onto proxy 2510. Asuser 2500 drags interacting device 2408 across a portion of proxy 2510,a line is generated substantially immediately and projected onto proxy2510 using projecting device 2404. With this arrangement, user 2500 seesproxy 2510 as having a modified appearance though no actual line hasbeen physically drawn on proxy 2510. In other words, virtual line 2602is projected onto proxy 2510 so as to appear to be a part of proxy 2510.

Referring now to FIG. 27, user 2500 may rotate proxy 2510 to continuedrawing virtual line 2602. As proxy 2510 is rotated, system 2400modifies the orientation of virtual line 2602 accordingly so thatvirtual line 2602 continues to appear as a line that is permanentlydrawn onto proxy 2510. This reorientation of virtual line 2602 may beaccomplished by tracking the position and orientation of proxy 2510 andrecalculating a new version of virtual line 2602 to accommodate changesin the position and orientation of proxy 2510.

System 2400 can include provisions for allowing a user to interact withone or more design tool menus. In some cases, system 2400 can includemenus that are visible to a user. In an exemplary embodiment, system2400 can project one or more menus onto a surface using projectingdevice 2404.

Referring to FIGS. 28 and 29, system 2400 can include tool palette 2802and color palette 2804. In this case, tool palette 2802 and colorpalette 2804 are virtual palettes. Furthermore, tool palette 2802 andcolor palette 2804 may be projected onto surface 2810, so that toolpalette 2802 and color palette 2804 are visible to user 2500.

Generally, system 2400 may be configured to project virtual menus ontoany type of surface including, but not limited to: floors, walls,tables, as well as any other kind of surfaces. Moreover, in some cases,a design system could be configured with specially designed surfaces forreceiving projected images of menus. In still other cases, menus couldbe projected directly onto a portion of a proxy. In the currentembodiment, surface 2810 is wall portion of workbench 2560.

Referring to FIG. 29, user 2500 may change the color of proxy 2510 usingcolor palette 2804. In particular, user 2500 may move interacting device2408 to a portion of surface 2810 corresponding to color palette 2804.System 2400 may detect the position of interacting device 2408 anddetermine that interacting device 2408 is selecting a portion of colorpalette 2804 corresponding to color 2902.

An augmented reality design system can include provisions for displayinga combination of real-world images and virtual images on a stationarydisplay device. For example, in one embodiment, virtual images may becombined with real-world images and displayed on a computer monitor orscreen.

FIGS. 30 through 32 illustrate an embodiment of augmented reality designsystem 3000, also referred to simply as system 3000. System 3000 caninclude one or more components. In one embodiment, system 3000 mayinclude computing device 3002. Computing device 3002 may be any type ofcomputer, including either a desktop or a laptop computer. In otherembodiments, computing device 3002 may be any type of device thatincludes a display, a processor, and the ability to transmit and receivedata from one or more external sources. Examples of such devicesinclude, but are not limited to: PDA's, cell phones, as well as othertypes of devices.

System 3000 can include provisions for displaying an augmented realityimage for a user. In some embodiments, system 3000 can include displaydevice 3004. Display device 3004 can be any type of display including,but not limited to: a computer screen or monitor, a head mounted unit, aprojection based display as well as any other kind of display. In thecurrent embodiment, display device 3004 may comprise a computer monitorthat is associated with computing device 3002.

System 3000 can include provisions for capturing visual information. Insome embodiments, system 3000 can include imaging device 3006. Imaginedevice 3006 can be any device capable of sensing optical information. Insome cases, imaging device 3006 can be a camera. In some cases, imagingdevice 3006 may be a video camera of some kind. Examples of differenttypes of video cameras that could be used include charge coupled device(CCD) cameras, complementary metal-oxide-semiconductor (CMOS) cameras,other types of active pixel sensor cameras as well as any other type ofvideo cameras.

Generally, imaging device 3006 can be disposed in any location withrespect to various components of system 3000. In some cases, imagingdevice 3006 can be stationary. In other cases, imaging device 3006 canbe mounted to another component of system 3000. In an exemplaryembodiment, imaging device 3006 may mounted to a user in some way. Forexample, in one embodiment, imaging device 3006 may be mounted to aheadset of some kind worn by the user. In other cases, however, imagingdevice 3006 may be disposed in a stationary location with respect to auser and/or a proxy. As an example, in the current embodiment, imagingdevice 3006 may be mounted to tripod 3050 (see FIG. 31). In still otherembodiments, imaging device 3006 could be a webcam type camera that maybe mounted to a portion of computing device 3002.

System 3000 can include provisions for interacting with an augmentedreality environment. In some cases, system 3000 can include interactingdevice 3008. Interacting device 3008 may take any form. In some cases,interacting device 3008 could comprise a stylus. For example,interacting device 3008 could comprise a stylus similar to the kind usedwith personal digital assistants (PDAs), in which the stylus is asubstantially monolithic component that is used for applying pressure toa display. In the current embodiment, interacting device 3008 is asubstantially monolithic component with the approximate shape of a pen.In other cases, however, interacting device 3008 could have any othershape, size and composition.

In some embodiments, one or more components of system 3000 maycommunicate with computing device 3002. In some cases, imaging device3006 may communicate with computing device 3002. Additionally, in somecases, display device 3004 may communicate with computing device 3002.Imaging device 3006 and display device 3004 could communicate withcomputing device 3002 using any type of wireless and/or wiredconnections. In some cases, imaging device 3006 and display device 3004can communicate with computing device 3002 using a network of some kind.Examples of such networks include, but are not limited to: personal areanetworks, local area networks, wide area networks, client-servernetworks, peer-to-peer networks, as well as other types of networks. Insome cases, a wireless local or personal area network using theBluetooth® protocol is used to facilitate communication betweencomputing device 3002 and imaging device 3006 and/or display device3004. With this arrangement, images gathered from imaging device 3006can be received by computing device 3002 and combined with virtualinformation. The combined information can then be transmitted back todisplay device 3004 to be displayed for a user. In particular, thisallows system 3000 to augment the view of a user with one or morevirtual objects or images.

Although the current embodiment uses a single imaging device, otherembodiments could include two or more imaging devices. Moreover, it willbe understood that in other embodiments any other kinds of sensors couldbe used with system 3000. An example of a system using additional kindsof sensors is discussed in detail below.

Although computing device 3002 is shown as a stand-alone computer in thecurrent embodiment, in other embodiments, computing device 3002 could beintegrate with other components of system 3000. For example, in anotherembodiment, computing device 3002 could be integrated with displaydevice 3004. In particular, display device 3004 could include provisionsfor processing optical information received by imaging device 3006 aswell as for generating virtual images to be displayed in display device3004. In still other embodiments, computing device 3002 could beintegrated with any other components of system 3000. In another example,computing device 3002 could be a portable device that may be worn orcarried by a user to enhance the portability of system 3000.Furthermore, in some embodiments, computing device 3002 may not belocated near various components of system 3000. For example, in anotherembodiment, imaging device 3006 and display device 3004 may communicateremotely with computing device 3002 using a network as discussed above.

Referring to FIGS. 31 and 32, user 3100 may create a design for anarticle using proxy 3110 with system 3000. It will be understood thatsystem 3000 may provide substantially similar design tools and menus tothe design tools and menus discussed with respect to the earlierembodiments. Moreover, in the current embodiment, user 3100 may viewreal-world images and virtual images on display device 3004. As user3100 applies various virtual design elements to proxy 3110 usinginteracting device 3008, the appearance of proxy 3110 as seen on displaydevice 3004 may be modified accordingly.

Although the previous embodiments include systems that utilize opticalrecognition software for purposes of tracking the motion and locationsof a proxy and an interacting device, in other embodiments one or morecomponents could be configured with additional sensors. In some cases, adesign system could include a proxy with sensors or other devicesconfigured to detect interactions with an interacting device. Likewise,in some cases, a design system could include an interacting device withone or more sensors for detecting interactions with a proxy. Moreover,in some cases, sensors and/or other devices in a proxy can be used todetect the location and/or orientation of the proxy. In a similarmanner, a sensor in an interacting device can be used to detect thelocation and/or orientation of the interacting device. A computingdevice may then receive information from one or more sensors todetermine where the user is pointing the interacting device with respectto the proxy. By using sensors, a design system may be capable ofprecisely calculating the relative locations and orientations of a proxyand an interacting device for purposes of applying one or more virtualdesign elements to the proxy.

While various embodiments of the invention have been described, thedescription is intended to be exemplary, rather than limiting and itwill be apparent to those of ordinary skill in the art that many moreembodiments and implementations are possible that are within the scopeof the invention. Accordingly, the invention is not to be restrictedexcept in light of the attached claims and their equivalents. Also,various modifications and changes may be made within the scope of theattached claims.

1. A method of designing an article, comprising the steps of: viewing aproxy on a display device, the proxy existing in a real-worldenvironment; contacting the proxy with an interacting device to create avirtual design for the article; and wherein the virtual design isdisplayed on the display device so as to appear to be a part of theproxy.
 2. The method according to claim 1, wherein the article is anarticle of footwear.
 3. The method according to claim 2, wherein theproxy is a footwear last.
 4. The method according to claim 2, whereinthe proxy is an article of footwear.
 5. The method according to claim 1,wherein the display device is a head mounted display that is worn by auser.
 6. The method according to claim 1, wherein the display device isa video monitor associated with a computing device.
 7. The methodaccording to claim 1, wherein the method further includes a step ofmanufacturing the article using the virtual design.
 8. A method ofdesigning an article, comprising the steps of: contacting a portion of aproxy with an interacting device to create a virtual design for thearticle; projecting the virtual design onto the proxy; and wherein thevirtual design is projected onto the proxy so as to appear to be a partof the proxy.
 9. The method according to claim 8, wherein a projectingdevice is used to project the virtual design onto the proxy.
 10. Themethod according to claim 9, wherein the projecting device is a videoprojector.
 11. The method according to claim 8, wherein the proxy is amannequin.
 12. The method according to claim 11, wherein the article isan article of clothing.
 13. The method according to claim 11, whereinthe article is a shirt.
 14. The method according to claim 11, whereinthe article is a pair of pants.
 15. The method according to claim 8,wherein the method further includes a step of manufacturing the articleusing the virtual design.
 16. A method of designing an article,comprising the steps of: viewing a proxy on a display device, the proxyexisting in a real-world environment and wherein a portion of the proxyhas a first color; contacting the portion of the proxy with aninteracting device; and thereby modifying the apparent color of theproxy as seen on the display device so that the color of the portion ischanged from the first color to a second color that is different fromthe first color.
 17. The method according to claim 16, wherein the stepof modifying the apparent color of the proxy as seen on the displaydevice comprises a step of creating a virtual design elementcorresponding to the portion of the proxy and wherein the virtual designelement has the second color.
 18. The method according to claim 16,wherein the proxy has the approximate shape of a human body.
 19. Themethod according to claim 18, wherein the article is an article ofclothing.
 20. The method according to claim 18, wherein the article is ahat.
 21. The method according to claim 18, wherein the article is aglove.
 22. A method of designing an article, comprising the steps of:selecting a color from a virtual color palette associated with a proxy,the proxy existing in a real-world environment and wherein a portion ofthe proxy has a first color; contacting the portion of a proxy with aninteracting device; projecting a second color onto the portion of theproxy substantially immediately after the interacting device hascontacted the portion; and thereby changing the apparent color of theportion.
 23. The method according to claim 22, wherein the proxy has theapproximate shape of a foot.
 24. The method according to claim 23,wherein the article is an article of footwear.
 25. The method accordingto claim 22, wherein the interacting device is a stylus.
 26. The methodaccording to claim 22, wherein the interacting device is pen shaped. 27.The method according to claim 24, wherein the portion of the proxycorresponds to an upper of the article of footwear.
 28. A method ofdesigning an article, comprising the steps of: viewing a proxy on adisplay device, the proxy existing in a real-world environment;contacting the proxy with an interacting device; displaying the virtualline on the display device substantially immediately after contactingthe proxy with the interacting device; and wherein the virtual line isdisplayed on the display device so as to appear to be a part of theproxy.
 29. The method according to claim 28, wherein the virtual line isapplied directly to a surface of the proxy.
 30. The method according toclaim 28, wherein the virtual line is a curved line that corresponds tothe contours of the proxy.
 31. The method according to claim 28, whereinthe virtual line is nonlinear.
 32. The method according to claim 28,wherein a thickness of the virtual line can be modified.
 33. The methodaccording to claim 28, wherein two or more virtual lines are applied tothe proxy.
 34. The method according to claim 28, wherein a virtualgraphic is applied to the proxy using the interacting device.
 35. Amethod of designing an article, comprising the steps of: contacting aproxy with an interacting device; projecting a virtual line onto theproxy substantially immediately after the interacting device hascontacted the proxy; and wherein the virtual line is projected onto theproxy so as to appear to be a part of the proxy.
 36. The methodaccording to claim 35, wherein the virtual line is projected directlyonto a surface of the proxy.
 37. The method according to claim 35,wherein the virtual line has a shape that corresponds to a shape of theproxy.
 38. The method according to claim 35, wherein the virtual linehas a curved shape.
 39. The method according to claim 35, wherein thevirtual line has a linear shape.
 40. The method according to claim 35,wherein the virtual line has a nonlinear shape.
 41. The method accordingto claim 35, wherein multiple virtual lines are projected onto to theproxy.
 42. An augmented reality design system, comprising: an imagingdevice for receiving images from a real-world environment; aninteracting device for interacting with a proxy in the real worldenvironment; a computing device capable of generating virtual images; adisplay device for viewing at least one virtual image superimposed ontothe proxy; a virtual menu that may be displayed on the display device,wherein the virtual menu is associated with a location in the real worldenvironment and wherein a user can interact with the virtual menu byplacing the interacting device in the location; and wherein the virtualmenu can be used to apply a virtual design element to the proxy.
 43. Thedesign system according to claim 42, wherein the virtual menu includes acolor palette.
 44. The design system according to claim 42, wherein thevirtual menu includes a drawing tool.
 45. The design system according toclaim 42, wherein the virtual menu includes a letter tool.
 46. Thedesign system according to claim 42, wherein the virtual menu includes avirtual graphic.
 47. The design system according to claim 42, whereinthe virtual menu includes an eraser tool.
 48. The design systemaccording to claim 42, wherein the virtual menu includes a selectiontool.
 49. An augmented reality design system, comprising: an imagingdevice for receiving images from a real-world environment; aninteracting device for interacting with a proxy in the real worldenvironment; a computing device capable of generating virtual images; aprojecting device for projecting at least one virtual image onto theproxy; a virtual menu that may be projected onto a location in thereal-world environment and wherein a user can interact with the virtualmenu by placing the interacting device in the location; and wherein thevirtual menu can be used to apply a virtual design element to the proxy.50. The design system according to claim 49, wherein the virtual designelement is a virtual line.
 51. The design system according to claim 49,wherein the virtual design element corresponds to a color.
 52. Thedesign system according to claim 49, wherein the virtual design elementis a virtual graphic.